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Abstract — Today's networks are controlled assuming pre- 
compressed and packetized data. For video, this assumption of 
data packets abstracts out one of the key aspects - the lossy 
compression problem. Therefore, first, this paper develops a 
framework for network control that incorporates both source- 
rate and source-distortion. Next, it decomposes the network 
control problem into an application-layer compression control, a 
transport-layer congestion control and a network-layer schedul- 
ing. It is shown that this decomposition is optimal for concave 
utility functions. Finally, this paper derives further insights from 
the developed rate-distortion framework by focusing on specific 
problems. 

I. Introduction 

Traffic forecasts predict mobile video to be a very significant 
slice (66%) of the world's mobile data by 2014 UJ. Video 
is different from data and voice as video-streaming quality 
can be varied, which impacts the user experience. Existing 
network architecture and protocols are primarily designed for 
data. Hence, majority of the literature assumes an existing 
packetized system, and then optimizes network performance 
0. An important component that is absent from such a 
framework is (lossy) compression. Compression is typically 
understood as an application-layer operation and thus sepa- 
rated from the network protocol stack optimization. However, 
the extent and nature of the compression employed critically 
impacts user experience, especially for video-streaming. As- 
suming the sources are already quantized/compressed leads to 
a formulation that presents only a partial picture on the quality 
of service observed by the users in the system. For instance, 
lightly-compressed video may require rates much higher than 
those that can be allocated while ensuring stable network 
operation, while heavily compressed video, although easy to 
deliver, reduces the quality of the end-user's experience. Thus, 
the distortion experienced by each user must be optimized 
to provide the best user experience (See |3), JH, J5| and 
references therein). 

In this paper, we build a framework for network control by 
applying rate-distortion theory |6|. Traditional network control 
can be viewed as a special case where the distortion (and 
thus compression algorithm) is fixed at a value independent 
of network state and overall user utility function. Distributed 
compression problems have been studied and partially solved 
for special cases (such as Gaussian and/or binary sources) 
for particular settings. Typically, there is no provably optimal 
separation between source and channel coding in networks. 
However, for the special case of independent sources being 
transmitted through the network, it is known that separate 



source and channel coding is optimal 0. In this paper, we 
focus on independent (uncompressed) sources in the network 
that must be compressed and subsequently transmitted through 
the network. This applies to many scenarios including video- 
streaming. Furthermore, focusing on source-channel separation 
allows us to develop a rate-distortion framework that scales 
with the network size, and hence, applicable to large real- 
world networks. 

A. Main results 

For networks with mutually independent (but possibly tem- 
porally correlated) sources, we consider the two quantities 
- (/) the source-entropy and (»') its distortion-offset that are 
sufficient in representing compression. We formally define 
these two quantities in Section HU Using these, we develop 
a framework for network control. Few of the important impli- 
cations of our framework are: 

• With lossy compression, the traditional notion of flow 
conservation does not hold. This has far-reaching conse- 
quences in network protocol design. 

• Our formulation based on source-entropy and distortion- 
offset has only linear constraints in addition to capac- 
ity constraints. Hence, if we focus on concave utility 
functions, existing convex optimization techniques can 
be applied, especially variants of distributed algorithms 
developed in HI. 

Based on the rate-distortion framework, we present the 
following results: 

• We show optimal decomposition of network control into 
three layers: (a) an application-layer with compression 
control, and (b) a transport-layer with congestion control, 
and (c) a network-layer with Max Weight scheduling. 

• For a compression problem with binary sources and 
proportional-fair like utility functions, we derive the op- 
timal control policy. The optimal policy requires varying 
distortion based on link-rate, and hence, clearly shows 
the sub-optimality of decoupling compression. 

« We solve a specific problem involving sending binary 
uncompressed sources over a Gaussian multiple access 
channel. 

B. Organization 

The next section presents the rate-distortion framework for 
network control. Section [III] derives an optimal decomposition 



into layers. Section [TV] studies a compression control prob- 
lem for binary sources. Section [V] applies the framework to 
Gaussian MACs. The paper concludes with Section [Vll 

II. A Rate-distortion framework for network 

CONTROL 

We consider a sing le-hopQ network with N indepen- 
dent sources, labeled i = 1,2, ...,N, The z-th (possibly 
continuous-valued) source Xi has an uncompressed-rate of Si 
symbols/sec. This source is compressed at a distortion of Di 
(per symbol, averaged across time) to a rate of Ci bits/sec. 
In other words, a lossy-compression code exists that maps 
vectors comprised of source symbols to binary vectors such 
that recovery is possible to within a distortion of Di per 
symbol. Mathematically, a rate-distortion code (operating over 
blocks of symbols of size n, with n large enough) of rate Cj+e 
bits/sec exists for source Xj such that reconstruction to within 
a distortion Di is possible such that e — > as n — > oo. 

This compressed source is transmitted over a link with link- 
rate of Ti bits/sec. The corresponding vectors are denoted 
by s, D, c and r, respectively. These link rates are coupled 
in a wireless network, and this, for a single-hop network, 
is captured by the A^-dimensional information-theoretic rate 
region denoted by C (This rate region may be the capacity 
region if the network's capacity region is known, or the best 
known rate region if unknown). The parameters introduced so 
far are associated with different functionalities in a network: 
(a) Si and Di are associated with (lossy) source-coding, (b) 
Ci is associated with congestion (or rate) control, and (c) r,; is 
associated with rate allocation (or scheduling). 

The source-coding, rate control and scheduling problems 
are tied to each other closely. As a result, the parameters 
associated with these problems must be jointly optimized. 
Therefore, we desire a framework that captures all these 
problems. However, the traditional framework does not include 
the source-coding component. It is based on the following 
optimization problem: 

N 

max y~]Ui(ci) (1) 

r L — J 

i=l 

subject to 

a < n,Vi, (2) 

r £ C. (3) 

In this framework, Ui(ci) in (HJ is the (concave) utility 
function associated with the (compressed) rate Ci of i-th source 
and (H}-© are capacity constraints. This framework can be 
decomposed into two layers: a transport-layer performing rate 
control, and a network-layer performing scheduling J9)- 

To incorporate the source-coding parameters, it is natural to 
utilize rate-distortion functions of sources studied in informa- 
tion theory |[T0l . For explaining this, we consider two source 
types: 

'The framework naturally extends to multi-hop networks. 



1) Binary sources with Hamming distortion: Consider 
independent Bernoulli(pi) binary sources that are mutu- 
ally independent arriving at rates of Si symbols/second. 
The rate-distortion function for this source is known to 
be 

R(s i ,D i ) = s i (H{p i )-H(D i )), (4) 

where H(-) is the binary entropy function. Now, moti- 
vated from (O, we define two variables to represent this 
source: (a) source-entropy 

oti = SiH(pi) (5) 

in bits/sec, where s; is the uncompressed-rate in sym- 
bols/sec and < pi < 1 is the given Bernoulli parameter 
of i-th source, and {b) (negative) distortion-offset 

ft = - Sl H{Di) (6) 

in bits/sec, where Di is the Hamming distortion per 
symbol. 

2) Gaussian sources with squared-error distortion: Con- 
sider zero-mean independent Gaussian sources with vari- 
ances of arriving at a rate of Si symbols per second. 
With squared-error distortion, the rate-distortion func- 
tion is known to be 

i?( Sl ,A)-|log 2 ^. (7) 

Now, differential source-entropy cti and distortion-offset 
Pi are defined as follows: 

a t = ^ lo S2 27recr i> 

where er| > is the given variance parameter of the z-th 
source, and 

ft = -^ lo &2 ZneDi, 

where Di is the squared-error distortion per symbol. 

Note that these two variables can take both positive and 

negative values. 
Now, source-entropy and distortion-offset can be identified 
as two parts of the rate-distortion function for multiple types of 
sources, both i.i.d. and correlated (for example, see Shannon's 
rate-distortion lower bound iflOl ). Denoting source-entropy 
and distortion-offset as oti and ft respectively, we have a 
tradeoff between the two of the form given by: 

ai + ft <Ci,Vi. (8) 

This simply states that the compressed rate should be higher 
than the fundamental limit given by the rate-distortion func- 
tion. Since distortion-offset terms appear in the constraints, it 
shows that flow conservation assumed in data networks does 
not hold for sources such as video. This motivates re-design 
of network protocol components that assume packets to be 
immutable. 

Now, a user's happiness (or user experience) can be thought 
of as a function of the source-entropy and distortion-offset. 



Therefore, a natural framework for network control is to 
maximize the sum of the user experience subject to all network 
constraints. For deriving a suitable layering architecture in 
the next section, we consider a slightly different looking but 
equivalent framework for network control: 

N 

max y2Vi(ai,0i) + Ui(*) (9) 

t=l 

subject to 

oa+Pi <Cj,Vi, (10) 
aiOi > OJifc < O.Vi, (11) 
ati+pi>0,Vi, (12) 

a < n,Vi, (13) 
r G C, (14) 

where m, b{ G {0, 1} are constants that are source-dependent, 
(fT0l- (fT2l are rate-distortion conditions and (fT3ll- ([l4T i are ca- 
pacity constraints. The rate-distortion framework in (0 has 
two main advantages, (i) It presents a notion of optimal net- 
work optimization while dealing with uncompressed sources. 
(ii) The constraints in ([ToTi-([T3l) are linear, and C in (fl4l is 
a convex set (with time sharing). Hence, with concave utility 
functions, we have a convex framework. 

III. Decomposition into Multiple Layers 

In this section, we show that the framework in © can be 
decomposed into three layers: (a) "application" layer with 
compression control, (b) "transport" layer with congestion 
control, and (c) "network" layer with (centralized) scheduling. 
As evident from the names, each of these layers has direct 
correspondence with a layer in the standard network protocol 
stack. 

We proceed by introducing two sets of dual variables. We 
introduce non-negative dual variables /ij,Vi (vector denoted 
by fi) corresponding to constraints in (fTOl i, and non-negative 
dual variables Aj,V« (vector denoted by A) corresponding to 
constraints in ( fT3l . With these dual variables, we obtain the 
following Lagrangian: 

N 

C = ^^K,/3 4 ) + f/,(c 4 ) 

i=l 

N N 
- ^ fii((Xi + Pi - Ci) - ^ ^i( c i - r i)- ( 15 ) 

Now, the dual objective g(fi, A) is defined as 

N 

g{H, A) = max V" Vi(a», ft) - Mt(«i + ft) 

CK./3,c.r * — ' 

i=l 

N 

+ y]Uj(ci) - (Aj - Ht)c t 

i=l 
N 

+ (16) 

i=l 

2 Ui(ci) can be absorbed into Vi(cti,/3i) 



subject to ([TT1i-(fl2]i and ( TT~4-b . From Langrange duality, it is 
well-known that g(fj,, A) gives an upper bound on the primal 
problem in (0 for feasible primal and dual variables. This 
leads to the dual problem to obtain an upper bound on the 
primal problem, given by 

min S>(/i,A) (17) 

/X, A 

s.t. Aj > Q,m > 0,Vi. 

For concave utility functions, under mild conditions IfTTI . it 
follows that this dual problem is tight, i.e., the optimal value 
of (fTTT i is equal to the optimal value of 

Now, it is fairly straightforward to see that the Lagrangian 
formulation in (TToT l decomposes into the following optimiza- 
tion problems: 

1) Distributed Compression Control: For all i, given /ij, 

max Vi(on,Pi) - + Pi) ( l8 ) 
s.t. a, ai > 0, < 0, on + ft > 0. 

2) Distributed Congestion Control: For all i, given //j 
and Aj, 

max U l (c i ) - (A, - ^;) c »- ( 19 ) 

3) Centralized MaxWeight Scheduling: Given all Aj, 

N 

max > AiTi (20) 

r ^ — ' 

i=l 

s.t. reC. 

In contrast to existing network control, the distributed 
compression problem in < fT~8T > is explicitly included in our de- 
composition. This problem jointly chooses source-entropy and 
distortion-offset based on the utility function. The congestion 
control in ( fl9l ) and the centralized scheduling in ( f20b match 
with those known in existing literature 12, lfl2l . Note that all 
three problems in < fT~8T >, ( fl9l ) and ( f20b are coupled through dual 
variables /x, A. In many cases, it is possible to use gradient 
methods to solve for the dual variables J9)- We do not delve 
into a discussion of such methods to solve these problems. 
Instead, we focus on two problems to obtain further insights 
in combining compression with network control - first, we 
study a compression control problem for binary sources, and 
then, we apply our framework to Gaussian multiple access 
channels (MACs). 

IV. Compression Control for Binary Sources 

Let us consider the lossy compression problem that 
determines source-entropy and distortion-offset given a 
compressed-rate. We study this problem to understand the 
tradeoff involved in choosing higher source-rate (with higher 
distortion) versus lower source-rate (with lower distortion). 
With utility functions that are strictly increasing, it follows 
that optimal parameters satisfy on + Pi < c, with equality. 



Under this setting, the compression control at every source is: 
for given a,, 6, and c. 



subject to 



max V(ci!j, Cj — a,) 

a^ai > 0, 
bi(ci - a>i) < 0. 



(21) 



In order to obtain explicit solutions to the optimization 
problem in ( f2TT > , we solve it in the context of binary source 
with Hamming distortion. For a binary source, we have a = 1 
and 6=1. Consider the utility function^ 



V(Oi, A) = l0g e OLi + Kifii, 



(22) 



for some constant Ki > 0. Note that this utility function is an 
extension of the proportional-fair utility function with linear 
penalty for distortion-offset. Therefore, d2Tb simplifies to 



max log e a t + Ki(d - af) 
s.t. an > a. 



(23) 



The unconstrained problem in d23l is maximized at on = 
1/Ki. Therefore, for the constrained problem in (1231 , we have 



1/K h if 1/Ki > Ci 
d, otherwise. 



(24) 



This simple rate-distortion-control policy can be implemented 
as long as the application layer is aware of the compressed-rate 

Ci- 

The expression in (l24l provides a simple rule to decide 
whether to transmit at zero-distortion, i.e., with source-entropy 
a.i — Ci and distortion-offset /3 ?; = 0, or transmit with 
distortion, i.e., source-entropy = 1/Ki an d distortion-offset 
(3 = Ci — 1/Ki. When 1/Ki > c %, substituting on = 1/Ki 
and pi — Ci — 1/Ki in © and ©, respectively, we get the 
following: uncompressed-rate s in symbols/sec is given by 

1 



KHip) ' 

and Hamming distortion A is given by the expression 

H(D t 



H(p) 



1 - CiK 



Recall that p is the Bernoulli parameter associated with source 
and H(-) is the binary entropy function. 

This compression rule is depicted in Figure Q] In simple 
words, this rule states that source-coding with distortion has 
to be performed at low compressed-rates and source-coding 
without distortion has to be performed at high compressed- 
rates. Furthermore, the amount of distortion introduced by the 
compression algorithm is piecewise linear. This shows that the 
traditional approach of decoupling compression control from 
network optimization is sub-optimal. In majority of existing 
video-streaming systems, compression control is performed 
using ad hoc algorithms. 

3 This is an example, and the choice of utility functions that is appropriate 
in practice is a subject for further study. 



H(D) 




Rate c 

Fig. 1, Distributed rate-distortion-control for binary sources; Region to the 
left of dashed line represents source-coding with distortion and to the right 
represents source-coding without distortion 



V. Rate-Distortion Framework applied to 
Multiple Access Channels 

Our goal is to understand the interplay between compression 
and communication - specifically, the way channel capacity 
and resulting distortion impact one another. We choose Gaus- 
sian multiple access channel (MAC) for our analysis here as 
they represent the simplest multi-terminal system model, and 
the capacity region for a MAC is well known iflOl . Further, we 
consider simple utility functions below that are only dependent 
on the distortion suffered in the compression process. These 
simplifications help us focus on our goal. 

Consider two i.i.d. Bernoulli(pi) binary sources that are 
mutually independent (across sources) arriving at rates of 
Si symbols per second. For a binary source with Hamming 
distortion, the rate-distortion function is given by The 
uncompressed-rates Sj are positive constants that are fixed by 
nature and assumed to be known. After compression, these 
two sources are to be communicated over a Gaussian multiple 
access channel. 

Now, network control for this example can be expressed as 



max 

D 



(25) 



subject to 



Sl (H(pi)-H(Di)) < C{Pi),Vi, 
2 

£ Sl (H( Pi ) - H{Di)) < C(P 1 + P 2 ), 

i=l 

A > 0, A < l,Vi. 

Here, we have used the capacity region of the Gaussian MAC 
channel. C(-) corresponds to Shannon's capacity formula 
given by 

C(P) = Wl + £ 



Note that, if the utility function in d25l l is concave in distortion, 
the optimization problem in d25l ) is in convex forrrQ. This 
follows from the fact that entropy is concave. 

Next, for deriving further insights into the network control 
problem, we consider the case where utility Vi(Di) in (f25b is 
a linear function of H(Di), i.e., 

Vi(Di) = -8iH{Di) 

for some constant Si > 0. With change of variables x.i = 
SiH(Di), from ( f25l l, we obtain an equivalent linear program 
(LP) (with sign of optimal value reversed) given by 



Si 5 2 
mm — xi H x 2 

xi,x 2 Si S 2 



(26) 



subject to 



Xi>SiH(pi)-C(Pi),Vi, 

xi+x 2 > siH(pi) + s 2 H(p 2 ) - C(Pi + P 2 ), 

Xi > 0, Xi < Vi. 

From properties of LP, it follows that at least one optimal 
solution exists that is a corner point of the feasible set, which 
is the convex polytope characterized by the constraints of the 
problem in (l26l l. More intuitively, we can obtain the optimal 
corner points for different cases based on where the source 
entropy vector H = (siH (pi), s 2 H (p 2 )) lies with respect to 
the MAC capacity region C: 

1) Case-A (H e C): The optimal corner point is D\ = 0, 
D 2 = 0, i.e., perform lossless source-coding. 
Case-B (H ^ C): It follows from the MAC capacity 
region (and utility function) that there are only two 
corner points of interest. These are the corner points on 
the sum-capacity boundary. The exact corner points and 
the condition for choosing between these corner points 
are as follows: If <5i/si > S 2 /s 2 , then 



2) 



8iH(Pl) 
s 2 H(D* 2 ) 

otherwise, 

siH(Dl) 
s 2 H(D* 2 ) 



[siH(pi)-C(Pi)]+, 
[siH(pi)-(C(Pi+P 2 ) 



C{Pi))\ 



[siH(pi) - (C(Pi 
[siH(pi)-C(P 2 )} 



P 2 ) - C{P 2 ))\ 



Here, [x] + denotes the positive part of x given by max{0, x}. 

Thus, we have explicitly solved the network control problem 
for this illustrative example. We depict this solution in Figure 
|2] This figure captures the intuitive distortion-control policy: 
compute weights and choose the corner point for operation 
corresponding to the largest weight. 
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Fig. 2. Optimal max-weight scheduling and distortion control for MAC with 
binary sources; Point-A corresponds to Case-A (no-distortion), and Point-B 
corresponds to Case-B (distortion) 



VI. Conclusion 

We incorporate lossy compression into network control 
using rate-distortion theory. We do so as a user's happiness 
is heavily dependent on the distortion he or she observes in 
the lossy compression process. For sources such as video, such 
an optimization is especially relevant. We provide a provably 
optimal layered architecture for performing network control 
with minimal deviation from existing architecture. 
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